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(54) Device for automatically aligning a production copy image with a reference copy image in a 
printing press control system 

(57) A device to align images lor a printing press 
control system comprising, a device (22,34) for captur- 
ing a reference image (40) containing one or more 
image planes from a reference copy (38), a device for 
converting the reference image into a monochrome ref- 
erence image, a device (22,34) for capturing a produc- 
tion image containing one or more image planes (16) 
from a production copy (14), a device for converting the 
production image into a monochrome production image, 
a device for defining at least one object model in the 
monochrome reference image, a device tor identifying 
the position of at least one of the object models in the 
production image, a device for defining a transfer func- 
tion which maps the position of the models in said mon- 
ochrome production image to the position of the models 
in said monochrome reference image, and a device for 
applying the transfer function to each of the image 
planes of the production image, resulting in its align- 
ment to the reference image. 
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Description 

The present invention relates to control systems for 
a printing press. 

In the past, four process inks (cyan, magenta, yel- 
low and black) have been used on a printing press to 
produce copies with a gamut of colors. To improve trap- 
ping and reduce ink cost, various undercolor removal 
techniques (UCR) and grey component replacement 
(GCR) techniques have been used in the color separa- 
tion processing. The UCR and GCR techniques remove 
a certain amount of the cyan, magenta and yellow ink 
from some printing areas and replace them with a cer- 
tain amount of the black ink. Thus, the black ink has 
been used to generate not only the text but also the 
color image, thus reducing the total volume of ink used 
to print. Different color separation equipment manufac- 
turers offer different UCR and GCR techniques to deter- 
mine when this black ink substitution will take place and 
what amount of inks will be substituted. 

In the past, the press room color reproduction qual- 
ity control process has been divided into two categories: 
"control by target" and "control by image." 

In the "control by target" method, a set of color con- 
trol targets is printed in a margin. Instruments, such as 
densitometers, are used to monitor the color attributes, 
such as the optical density, of these targets. The print- 
ing press is then adjusted based on the measured devi- 
ation of these control targets from a predefined attribute 
value. The application of this method for quality control 
creates waste and consumes resources in that an addi- 
tional process is required to cut off this target from the 
final product. It also requires a tight material control for 
paper, ink, and other printing parameters. 

In the "control by image" method, the print image on 
a production copy is compared with the printed image 
on a reference copy, called a proof. The press is then 
adjusted based on the difference between the produc- 
tion image and the reference image. This system is 
more versatile because it does not require an additional 
target to be printed. The "control by image" method is 
also more accurate than the "control by target" method 
because in some situations although the measured 
attributes of control targets on the production and refer- 
ence images are the same, the two images will look dif- 
ferent. Conventionally, both the image comparing task 
and the press adjusting task are performed by a press 
operator. To improve the productivity and the color con- 
sistency, several automatic printing quality inspection 
systems have been reported recently. These systems 
use opto-electronic sensor devices, such as a spectro- 
photometer, or CCD color cameras, to measure the 
color reproduction quality. Currently, the bandwidth of 
these sensor devices is limited to the visible region of 
400 nm through 700 nm in wavelength of the electro- 
magnetic spectrum. However, within the visible region, it 
is not possible for these devices to reliably distinguish 
the black ink from the process black made by the com- 
bination of cyan, magenta, and yellow inks, or to deter- 
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mine whether the black ink or all cyan, magenta, and 
yellow inks should be adjusted. Although these devices, 
such as spectrophotometers, might be able to measure 
the printed color accurately, it is difficult to use the 

5 measured color information to achieve the automatic 
control for a four-color press without a target due to the 
involvement of the UCR and GCR techniques. A control 
method without targets could require selecting the 
points in the image to be measured or a large number of 

w measurements would have to be acquired. A camera 
system can acquire a large number of measurements 
simultaneously, giving it an advantage when targets are 
not printed. 

It has been found, during the process of gathering 
is data from the production and reference copies in prepa- 
ration for the comparison task, that a production copy 
might be placed under the camera field of view in a posi- 
tion other than that occupied by the reference copy 
when its image was acquired. Since electronic compar- 
ed isons are made between the images in such small 
areas, it is nearly impossible to humanly align the pro- 
duction image in the same location as that previously 
occupied by the reference. The process used to manu- 
facture the printed material also compounds the prob- 
25 lem of positioning since the paper may be cut in a 
different place from copy to copy. The image may be 
printed in a different location on the moving press web 
as rolls of paper replenish the process. Each of these 
conditions makes it more difficult to align copies manu- 
30 ally, even with the aid of an alignment guide such as a 
straight edge fixed to a table. Exact alignment is neces- 
sary since comparisons between the two images occur 
on a pixel by pixel basis which may represent copy dis- 
placement on the order of hundredths or thousands of 
35 an inch. It is clear that an automatic alignment device is 
necessary so that the features and color in one image 
might be compared with the exact same features and 
color in a second image within reasonable limits. 

40 SUMMARY OF THE INVENTION 

A principal feature of the present invention is the 
provision of a device to align images for a printing press 
control system. 

45 The device comprises, means for capturing a refer- 
ence image containing one or more image planes from 
a reference copy, means for converting the reference 
image into a monochrome reference image, means for 
capturing a production image containing one or more 

so image planes from a production copy, means for con- 
verting the production image into a monochrome pro- 
duction image, means for defining at least one object 
model in the monochrome reference image, means for 
identifying the position of at least one of the object mod- 

55 els in the production image, and means for defining a 
transfer function which maps the position of the models 
in the monochrome production image to the position of 
the models in the monochrome reference image. 

A feature of the invention is the provision of means 
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for applying the transfer function to each of the image 
planes of the production image, resulting in its align- 
ment to the reference image. 

Another feature of the invention is the provision of 
means for defining a transfer function which maps the 
model position on the monochrome production image to 
the model position of the monochrome reference image. 

Another feature of the invention is that the resultant 
images of the production copy will be aligned with those 
captured from the reference copy. 

A further feature of the invention is that the system 
automatically aligns the production image with the refer- 
ence image. 

A further feature of the invention is that up to four 
models can be defined in the monochrome reference 
image. Therefore, the production image can still be 
aligned with the reference image even if one, two, or 
three models cannot be located in the monochrome pro- 
duction image when the printed copy is severely 
degraded. 

Further features will become more fully apparent in 
the following description of the embodiments of the 
invention, and from the appended claims. 

DESCRIPTION OF THE DRAWINGS 

In the drawings: 

FIG. 1 is a block diagram of a control system for a 

printing press of the present invention; 

FIG. 2 is a diagrammatic view of the system of FIG. 

1; 

FIG. 3 is a block diagram of the control system of 
FIG. 1; 

FIG. 4 is a diagrammatic view of a camera or sen- 
sor for the control system of the present invention; 
FIG. 5 is a diagrammatic view of another embodi- 
ment of the camera or sensor for the control system 
for the present invention; 

FIG. 6 is a diagrammatic view of a further embodi- 
ment of a camera or sensor for the control system 
of the present invention; 

FIG. 7 is a chart plotting the normalized percentage 
of IR Reflection against the percentage Dot Area in 
a printed sheet; 

FIG. 8 is a diagrammatic view of a spectrum of elec- 
tromagnetic waves including the visible spectrum 
and the infrared spectrum; 

FIG. 9 is a diagrammatic view of set of elements for 
a sensor space and ink space; 
FIG. 10 is a block diagram of the sensor space and 
ink space in conjunction with the control system of 
the present invention; 

FIG. 1 1 is a block diagram of the control system for 

adjusting the printing press; 

FIG. 1 2 is a diagrammatic view of a production copy 

being misaligned with a reference copy; 

FIG. 13 is a block diagram of the device of the 

present invention; 



FIG. 14 is a diagrammatic view showing search 
regions and models; 

FIG. 15 is a diagrammatic view showing the models 
in a reference copy and production copy; and 
5 FIGS. 16-19 are diagrammatic views showing dif- 

ferent transfer functions when one, two, three, or 
four models are found, respectively. 

DESCRIPTION OF THE PREFERRED EMBODI- 



Referring now to FIG. 1 . there is shown a control 
system generally designated 10 for a printing press 11 
of the present invention. 

15 The control system 10 has a 4 channel sensor 21, 
a data converter 23 for processing information from the 
sensor 21 , and a device 25 for controlling ink for the 
press 1 1 . As will be seen below, the 4 channel sensor 
21 detects the energy reflected from a paper surface, 

20 such as the paper web for the press 1 1 , in both the vis- 
ible region and the infrared region of the electromag- 
netic spectrum. As shown in FIG. 8, electromagnetic 
waves in the infrared region have a longer wave length 
than the visible spectrum, with the wave lengths of the 

25 electromagnetic waves in the region of visible light 
being approximately 400 to 700 nanometers (nm), and 
the wave lengths of the electromagnetic waves in the 
infrared region, including near infrared, being equal to 
or greater than 800 nm. 

30 As show in FIG. 2, the control system 10 has a sup- 
port 12 for placement of a sheet of paper 14 with image 
or indicia 16 on the sheet 14 in a configuration beneath 
a pair of opposed lights 18 and 20 for illuminating the 
sheet 14, The system 10 has a first color video camera 

35 or sensor 22 having three channels for detecting 
attributes of the inks from the sheet 14 in the visible 
region of the electromagnetic spectrum such as red, 
green and blue, or cyan, magenta, and yellow, and for 
sending the sensed information over separate lines or 

40 leads 24, 26, and 28 to a suitable digital computer 30 or 
Central Processing unit having a randomly addressable 
memory (RAM) and a read only memory (ROM), with 
the computer or CPU 30 having a suitable display 32. 
Thus, the three distinct color attributes of the inks are 

45 sensed by the camera 22 from the sheet 14, and are 
received in the memory of the computer 30 for storage 
and processing in the computer 30. 

The system 10 also has a black/white second video 
camera or sensor 34 having a filter 50 such that it 

so senses the attributes of the inks in the infrared region of 
the electromagnetic spectrum, having a wave length 
greater than the wave length of the electromagnetic 
waves in the visible region of light. The camera or sen- 
sor 34 thus senses infrared information from the sheet 

55 14, and transmits the sensed information over a lead 36 
to the computer 30, such that the information concern- 
ing the infrared rays is stored in and processed by the 
computer 30. 

The normalized percentage of infrared (IR) reflec- 
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tion vs. the percentage of dot area is show in the chart 
of FIG. 7. It will be seen that the infrared reflectance of 
cyan, magenta, and yellow inks show no significant 
change as a function of percentage of dot area. How- 
ever, the normalized infrared reflectance of the black ink 5 
displays a significant change as a function of percent- 
age of dot area, and changes from a normalized value 
of 100% IR reflection for 0% dot area to approximately 
18% IR reflection corresponding to 100% dot area. 
Hence, the black ink may be easily sensed and distin- 10 
guished from other color inks in the infrared region of 
the electromagnetic waves. 

As shown in FIG. 2, the sheet 14 may contain 
printed image or indicia 16 which is obtained from a cur- 
rent press run of the press 1 1 , termed a production or 15 
current copy. In addition, a sheet 38 containing printed 
image or indicia 40, termed a reference copy, from a 
previous reference press run may be placed on the sup- 
port 12 beneath the cameras 22 and 34 in order to 
sense the energy reflected from the sheet 38, and send 20 
the sensed information to the memory of the computer 
30 for storage and processing in the computer 30, as 
will be described below. 

Thus, the cameras or sensors 22 and 34 may be 
used to sense both the current copy or sheet 1 4 and the 25 
reference copy or sheet 38. The information supplied by 
the cameras 22 and 34 is formed into digital information 
by a suitable analog to digital converter in a frame grab- 
ber board on the computer 30. Thus, the computer 30 
operates on the digital information which is stored in its 30 
memory corresponding to the information sensed from 
the sheets 1 4 and 34 by the cameras or sensors 22 and 
34. 

Referring now to FIG. 3, there is shown a block dia- 
gram of the control system 10 for the printing press 1 1 35 
of the present invention. As shown, the four inks (cyan, 
magenta, yellow, and black) of the four-color printing 
press 1 1 are first preset, after which a print is made by 
the press 1 1 with a current ink setting, thus producing a 
production or current printed copy, as shown. The color 40 
and black/white video cameras or sensors 22 and 34 of 
FIG. 2 serve as a four channel sensor 21 to capture an 
image of the current printed copy, and then place this 
information into the memory of the computer 30 after it 
has been formed into digital information. 45 

Next, an "Ink Separation Process" 23 is used to 
convert the red, green, blue and IR images captured by 
the four channel sensor 21 into four separated cyan, 
magenta, yellow and black ink images, which represent 
the amount of corresponding ink presented on the live 50 
copy. The "Ink Separation Precess" 23 may utilize math- 
ematic formulas, data look up tables or other suitable 
means to perform the data conversion task. 

The similar processes are also applied to the refer- 
ence copy First, the four channel sensor 21 is used to 55 
capture the red, green, blue and IR images from the ref- 
erence copy. Then, the "Ink Separation Process" 23 is 
utilized to obtain the cyan, magenta, yellow and black 
ink images, which represent the amount of correspond- 



ing ink presented on the reference copy. 

As shown, the ink images of the production copy 
are compared with the ink images of the reference copy 
by the computer 30 to detect the variation of ink distribu- 
tion for each of the cyan, magenta, yellow and black 
inks. 

The determined differences in ink distribution are 
then processed by the computer 30 in order to obtain an 
indication for controlling the keys or other devices of the 
press 11 in an ink control process, and thus provide an 
indication of an ink adjustment to the press to obtain fur- 
ther copies which will have a closer match to the refer- 
ence copy. The indication of ink changes may be 
automatically supplied to the press 1 1, or the operator 
may utilize the indications of ink color attributes to set 
the press 11, such as adjustments to ink input rate by 
using the keys. 

In the past, four process inks (cyan, magenta, yel- 
low, and black) have been used on a printing press to 
produce copies with a gamut of colors. In these sys- 
tems, the black ink has been used to generate not only 
the text but also the color image. In a control by image 
system, the print image of a production copy is com- 
pared with the printed image on a reference copy, 
termed a proof, and the press is adjusted based on the 
difference between the production image and the refer- 
ence image. However, within the visible region, it is not 
possible to reliably distinguish the black ink from the 
process black made by the combination of cyan, 
magenta, and yellow inks, or whether the black ink or all 
cyan, magenta, and yellow inks should be adjusted. 

The four channel sensor 21 is utilized to sense not 
only attributes in three channels of the visible region, 
the fourth channel of the sensor 21 senses an attribute 
in the infrared region in order to determine the correct 
amount of inks, including black ink, to correctly repro- 
duce the proof. The printing press control system uses 
the four channel detector or sensor 21 to detect the 
energy reflected from a paper surface, such as the 
sheets 1 4 and 38, or the paper web of the press 1 1 , with 
three channels being in the visible region and one chan- 
nel being in the infrared region of the electromagnetic 
spectrum. The control system 10 has a device 23 for 
converting the output of the sensing device 21 to a set 
of variables which represent the amount of ink pre- 
sented on the paper for any of the cyan, magenta, yel- 
low, and black inks, and a device 25 responsive to the 
converting device 23 for adjusting the four-color printing 
press 1 1 to maintain the color consistency. 

In a preferred form, the bandwidth of the infrared 
channel may be between 800 nm and 1100 nm, which 
is a portion of the near infrared region, and which is 
compatible with a regular silicon detector, although the 
working wavelength of the infrared channel may be 
longer than 1100 nm. At least three distinct channels 
are utilized in the visible region which may correspond 
to red, green, and blue (RGB), or cyan, magenta, and 
yellow (CMY), or other colors. The bandwidth of each 
channel in the visible region may be less than 70 nm, 
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more than 100 nm, or any value inbetween, with chan- 
nels having a multiple peak in its passing band, such as 
magenta, being also included. 

The sensor device 21 may be constructed from 
either a single element detector, a one-dimensional (lin- 
ear) detector, a two-dimensional (area) detector, or 
other suitable detector structure, as will be seen below. 
The sensor device may be constructed by adding an 
additional infrared channel to existing devices, adding 
an infrared channel to a RGB color camera or a densit- 
ometer, or by extending the working band into the infra- 
red region, e.g., adding infrared capability to a 
spectrophotometer. The light source 18 and 20 used 
provides sufficient radiated energy in both the visible 
region and the infrared region, depending upon the sen- 
sor working band and sensitivity. 

All possible values which are output from the sen- 
sor device 21 may be used to form a vector space. For 
example, all possible values output from the sensor 
device 21 with red, green, blue and infrared channels 
form a four dimensional vector space R-G-B-IR, with the 
vector space being termed a sensor space S 1( with 
each output from the sensor device 21 being termed a 
vector in the sensor space S 1f with the minimum 
number of dimensions required by the sensor structure 
being 4. Thus, as shown in FIG.9, a set Si of elements 
! and 2 being given, with the elements e-i 1 of the set 
S-i being the vectors v n corresponding to the output 
from the sensor device 21 of sensing a production or 
current printed copy, and with the elements e 12 of the 
set S 1 being the vectors v 12 corresponding to the output 
from the sensor device 21 sensing a reference printed 
copy. In accordance with the present invention, the 
printed image on a production or current copy may be 
compared with the printed image on a reference copy in 
the sensor space, and if the difference between the live 
copy L.C. S and the reference copy R.C. S is within a pre- 
defined tolerance level delta, at least for all the channels 
in the visible region of the sensor space, such that, 
[ L.C. s - R.C. s ] < delta , the production or current copy 
is said to be acceptable by definition. 

A set of variables may be defined to represent the 
amount of ink presented in a given area. For example, a 
set of variables C, M, Y, and K can be defined to repre- 
sent or be a function of the amount of cyan, magenta, 
yellow, and black ink in a given area. This set of varia- 
bles may correspond to the ink volume, average ink film 
thickness, dot size, or other quantities related to the 
amount of ink in a given area on the paper surface. The 
vector space formed by this set of variables is termed an 
ink space S 2 with the ink space S 2 having a dimension 
of 4 for a four color printing press 1 1 . Thus, with refer- 
ence to FIG. 9, a set S 2 of elements d^ and d 12 are 
given, with the elements d-n of the set S 2 being the vec- 
tors vj! corresponding to the variables associated with 
the production or current copy in the ink space S 2 , and 
with the elements d 12 of the set S 2 being the vectors Vj 2 
corresponding to the variables associated with the refer- 
ence copy in the ink space s 2 . 



With reference to FIG. 9, there exists at least one 
transfer function or transformation phi which can map 
the elements d-j -, and d-j 2 of the set S 2 or the four dimen- 
sional ink space, into the elements e^ and e 12 of the 
5 set s<\ or the four dimensional sensor space, with the 
transformation phi being termed a forward transfer func- 
tion, as shown in FIGS. 9 and 10. It is noted that the 
subsets in each set St and S 2 may overlap or may be 
the same. 

10 The forward transfer function may be used in a soft 
proof system which can generate a proof image which 
can be stored in the system as a reference or can be 
displayed on a CRT screen. 

With further reference to FIG. 9, there exists at least 

75 one transfer function or reverse transformation phi" 1 
which can map the elements e-n and e^ 2 of the set S-| of 
the four dimensional sensor space into the elements of 
d^ and d 12 of the set S 2 of the four dimensional ink 
space, with the transfer function being termed a reverse 

20 transfer function. Thus, both the production image and 
the reference image in the sensor space or set S 1 can 
be mapped into the ink space or set S 2 by applying the 
reverse transfer function phi* 1 point by point as shown in 
FIGS. 9 and 10. 

25 The difference between the production image and 
the reference image in the ink space S 2 thus represents 
the difference of the ink distribution for each of the cyan, 
magenta, yellow, and black inks, as shown in FIG. 1 1 . 
The difference between the live and reference images in 

30 the ink space S 2 indicates which printing unit should be 
adjusted, which direction, up or down, it should be 
adjusted, and the amount of ink which should be 
adjusted. A suitable press control formula may be devel- 
oped to adjust press parameters, such as ink input rate 

35 in lithographic or letterpresses, ink consistency in flexo- 
graphic or gravure presses, water input rate in litho- 
graphic presses, or temperature in any of the above, 
based on the differences between the production and 
the reference image in the ink space S 2 . 

40 In accordance with the present invention, the press 
adjustments can be achieved by the automatic control 
system 1 0, by press operator alone, or by the interaction 
between the automatic control system 1 0 and the press 
operator. Also, the sensor device 21 may be used to 

45 monitor the printing web of the press 1 1 directly, i.e., on 
press sensing, or to monitor the prints collected from 
the folder of the press, i.e., off press sensing. If the dig- 
ital images from the color separation processing, or the 
film/plate images are available, the image of the refer- 

50 ence copy in the sensor device 21 can be generated 
electronically by the forward transfer function phi. The 
electronically generated reference may be used to set 
up the press 1 1 in order to reduce the make ready time. 
The color reproduction quality can be maintained 

55 through the entire press run, through different press 
runs on different presses, or at different times. Thus, a 
closed loop automatic color reproduction control system 
may be formed without an additional color control tar- 
get. The variation of ink, paper, and other press param- 
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eters can be compensated such that the printed copies 
have the highest possible overall results in matching the 
reference copy. 

As shown in FIG. 4, the camera or sensor 22 may 
be associated with a rotating filter member 52 having fil- 
ters which only transmit the desired colors F 2 , and 
F 3 , such as red, green, and blue during rotation, such 
that the camera or sensor 22 senses and records the 
colors F^ F 2 , and F 3 , sequentially or separately from 
the printed material which may be taken either from the 
current press run or from the reference press run. In 
addition, the filter member 52 may have an infrared (IR) 
filter F 4 in order to sense and record the energy 
reflected form the printed material in the infrared region. 
The information received by the camera or sensor 22 
from the filters may be recorded in the computer or CPU 
for use in forming the desired data to control the inks, as 
previously discussed. 

In another form as shown in FIG. 5, the camera or 
sensor 22 may comprise a charge coupled device 
(CCD) with built in filters which converts light energy 
reflected from the printed material into electric energy in 
a video camera, i.e. F 1f F 2 , F 3 , and F 4 , (IR), such as the 
distinct colors red, green, and blue in the visible region, 
and the near infrared energy in the infrared region, in 
order to supply the information to the computer 30 for 
storage and processing, as previously discussed. 

Another embodiment of the camera or sensor 22 of 
the present invention is illustrated in FIG. 6, in which like 
reference numerals designate like parts. In this embod- 
iment, the camera or sensor 22 has a beam splitter in 
order to separate the incoming light reflected from the 
printed material into an infrared beam for a first CCD 1 , 
Fi such as red for a second CCD 2, F 2 such as green for 
a third CCD 3, and F 3 such as blue for a fourth CCD. In 
this embodiment, suitable prisms, lenses, or mirrors 
may be utilized to accomplish the beam splitting of light 
in order to obtain the desired color attributes in the vari- 
ous charge coupled devices to supply the information to 
the computer 30 for storage and processing in the com- 
puter 30, in a manner as previously described. Of 
course, any other suitable camera or sensing device 
may be utilized to obtain the desired colors. 

Thus, a control system 10 for a printing press 1 1 is 
provided which ascertains three distinct attributes, such 
as colors, in the visible region of electromagnetic waves 
and an attribute in the infrared region of the electromag- 
netic spectrum for the printed inks. The control system 
10 utilizes these four attributes in a four channel device 
to indicate and control the ink colors for use in the press 
11. 

Thus, the colors may be sensed from a sheet taken 
during a current press run, and from a sheet taken dur- 
ing a reference press run, after which the sensed infor- 
mation is utilized in order to modify ink settings of a 
press 1 1 in order to obtain repeatability of the same 
colors from the reference run to the current press run. In 
this manner, a consistent quality of colors may be main- 
tained by the printing press 11 irrespective of the 



number of runs after the reference run has been made, 
and may be continuously used during a press run if 
desired. 

It has been found when reference or production 
s copies are placed in the field of view of the camera that 
a production copy might be placed under the camera 
field of view in a position other than that occupied by the 
reference copy when its image was acquired, as show 
in Fig. 12. Since electronic comparisons are made 
10 between the images in such small areas, it is nearly 
impossible to humanly align the production image in the 
same location as that previously occupied by the refer- 
ence. The process used to manufacture the printed 
material also compounds the problem of positioning 
15 since the paper may be cut in a different place from 
copy to copy. The image may be printed in a different 
location on the moving press web as rolls of paper 
replenish the process. Each of these conditions makes 
it more difficult to align copies manually, even with the 

20 aid of an alignment guide such as a straight edge fixed 
to a table. Exact alignment is necessary since compari- 
sons between the two images occur on a pixel by pixel 
basis which may represent copy displacement on the 
order of hundredths or thousands of an inch. It is clear 

25 that an automatic alignment device is necessary so that 
the features and color in one image might be compared 
with the exact same features and color in a second 
image within reasonable limits. 

The device described herein and shown in Fig. 13 

30 performs the alignment function by declaring an image 
feature to be an object model, or model. When the same 
feature is found in the production image, the center of 
this model can be electronically aligned with the center 
of the model found in the reference image. While the 

35 process is described in detail for up to four models per 
image, more models can be used. Alignment of the four 
models in the production image to those in the refer- 
ence image implies all other features in the image are 
accordingly aligned. 

40 in accordance with the present invention, a color 
image is captured from the printed material designated 
as being the reference. This function is performed with 
a camera, a digitizing board and a computer. The com- 
puter memory then contains numeric values for picture 

45 elements contained in the imager (camera). Values are 
present for red, green and blue pixels (picture ele- 
ments). A translation is then performed to correct any 
geometric distortion caused by the lens, if necessary. 
The red, green and blue values from a pixel are then 

so averaged providing a resultant monochrome image. 
The three components (red, green, blue) of a color 
image are converted to a single black and white image 
through this averaging process so features may be 
found in only one image plane rather than three. It also 

55 reduces the difficulty in finding a model in an image 
when the color content of the production image is 
slightly different from that of the reference image. This 
could occur if the amount of ink delivered to the paper 
changes during the printing process. 
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Once the reference is captured, up to four models 
are defined within the image, as shown in Fig. 14. This 
is done by dividing the image into four pieces (quads) 
and then defining a model in each of the quads. A model 
will typically be a feature rich area of the image within 5 
the quad. Features are denoted as transitions from dark 
to light in the monochrome image. The model, or 
number of features to be labeled as the model will 
occupy a space smaller than the quad in the image. 
While it is desirable that the model be a unique set of w 
features within the quad, it actually only has to be 
unique within an arbitrary search region which encom- 
passes the model position and the immediate space 
around it. The search region is constrained to a suffi- 
ciently large group of pixels within the camera so as to 75 
have the features of the model within its bound when 
subsequent copies are placed under the camera with 
maximum misalignment. At this point, four search 
regions have been defined to surround each of the 
model positions in the monochrome reference image as 20 
shown in Fig. 14. 

A production copy is then placed in the field of view 
of the camera, and a color image is captured. The color 
image is then converted to a monochrome image, as 
described above. The device then looks for a model 25 
within the models search region. Each potential lind" is 
given a score indicating the likelihood that the model 
features were actually found. Based on the score, the 
device then declares a model as found or not found. 
This process occurs for each of the four models. Models 30 
may not be found if printed matter placed under the 
camera is misaligned more than the maximum amount 
specified in the search region. Models also may not be 
found if the copy is severely degraded. Figure 15 shows 
defined model positions in the reference image and 35 
found model positions in the production image. 

If at least one model is found, a transfer function is 
defined which maps the found model positions to the 
defined model positions. One such transfer function 
could be a bi-linear function. The transfer functions for 40 
the number of models found are illustrated in FIGS. 16- 
19. Based on the number of models found, this transfer 
function, may be either a translation, rotation, scaling, 
warping function, or any combination of these. This 
alignment processing is performed for all image planes 45 
obtained from the production copy. The resultant 
images will be aligned with those captured from the ref- 
erence copy. 

When the device is used to align images so that the 
color may be compared between the reference and pro- so 
duction copies, more image planes may be captured 
than just the three components (red, green and blue) of 
the color image. For instance, a near infrared image 
may also be captured. This image would not have to 
contribute to the creation of the monochrome image but 55 
the aligning transform would be applied to this image so 
that the four image planes of the production image 
would align over the four image planes of the reference 
image. 



12 

The foregoing detailed description has been given 
for clearness of understanding only, and no unneces- 
sary limitations should be understood therefrom, as 
modifications will be obvious to those skilled in the art. 

Claims 

1 . A device to align images for a printing press control 
system, comprising: 

means for capturing a reference image con- 
taining one or more image planes from a refer- 
ence copy; 

means for converting the reference image into 
a monochrome reference image; 
means for capturing a production image con- 
taining one or more image planes from a pro- 
duction copy; 

means for converting the production image into 

a monochrome production image; 

means for defining at least one object model in 

the monochrome reference image; 

means for identifying the position of at least 

one of the object models in the production 

image; 

means for defining a transfer function which 
maps the position of the models in said mono- 
chrome production image to the position of the 
models in said monochrome reference image; 
and 

means for applying the transfer function to 
each of the image planes of the production 
image, resulting in its alignment to the refer- 
ence image. 

2. The device of claim 1 wherein the capturing means 
includes means for capturing an infrared image. 

3. The device of claim 1 including means for perform- 
ing an image warp to correct any geometric distor- 
tion caused by a lens. 

4. The device of claim 1 including means for limiting a 
maximum displacement between the production 
and reference copy images. 

5. The device of claim 1 including means for dividing 
the images into four quads. 

6. The device of claim 1 wherein the defining means 
defines four object models in the monochrome ref- 
erence image, with one model being defined in 
each quad of the image. 

7. The device of claim 1 including means for defining 
a search region for each of the models, means for 
searching for the models within the search regions 
to find the position of the models in the mono- 
chrome production image, and means for providing 
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each model a score indicating the degree of match. 



8. The device of claim 1 wherein the converting 
means averages pixel values for a plurality of image 
planes. 5 

9. The device of claim 1 including means for defining 
search regions of the models. 

10. The device of claim 1 wherein the transfer function 10 
performs a translation, rotation, scaling or warping 
function, or any combination of these functions. 

1 1. A device to align images for a printing press control 
system, comprising: 15 

means for capturing a reference image from a 
reference copy; 

means for capturing a production image from a 
production copy; and 20 
means for aligning one of said images with the 
other of said images. 
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Fig. 2 
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Fig. 4 
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Fig. 5 
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Fig. 14 
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Ma^and Ma>y are the maximum misalignment 
between the production and reference copy 
images in the horizontal and vertical direction, 
respectively. 
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Fig. 16 
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x = u + A 

y = v + B, 
where A and B are constants 

If only one model is found, production 
images can be translated to a new location 
without changing the size, shape or 
orientation. 
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Fig. 17 
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If two models are found, production 
copy can be translated and scaled by the 

following transfer function: 

x = Au + B 
y = Cv + D , 

where A, B, C, and D are constants. 
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Fig. 18 
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If three models are found, production copy 
can be translated, scaled, and rotated to 

align with the reference copy according to 

the following transfer function: 



< 



x = Au + Bv + C 
y = Du + Ev + F, 



L. 



where A, B, C, D, E, and F are constants 
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If all four models are found, production copy 
can be translated, scaled, rotated, and 

warped by the following bilinear transfer 

function: 



< 



x = Au + Buv + Cv + D 
y = Eu + Fuv + Gv + H, 



where A, B, C, D, E, F, G, and H are constants. 
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